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Abstract — Existing convex relaxation-based approaches to re- 
construction in compressed sensing assume that noise in the 
measurements is independent of the measurements themselves. 
We consider the case of noise correlated with the compressed 
measurements and introduce a simple technique for improvement 
of compressed sensing reconstruction from such measurements. 
The technique is based on a linear model of the correlation of 
additive noise with the measurements. The modification of the 
reconstruction algorithm based on this model is very simple and 
has negligible additional computational cost compared to stan- 
dard reconstruction algorithms. The proposed technique reduces 
reconstruction error considerably in the case of correlated mea- 
surements and noise. Numerical experiments confirm the efficacy 
of the technique. The technique is demonstrated with application 
to low-rate quantization of compressed measurements, which 
is known to introduce correlated noise, and improvements in 
reconstruction error up to approximately 7 dB are observed for 
1 bit/sample quantization. 

I. Introduction 

IN the recently emerged field of compressed sensing, one 
considers linear measurements y of a sparse vector x, 
possibly affected by noise as: 

y = Ax + n, (1) 

where the measurements y G JR Mxl , the sparse vector x E 
R Nxl , the additive noise n G R Mxl , the system matrix A G 
R MxN , and M < N [l]-[3]. A is generally the product of a 
measurement matrix and a dictionary matrix: A = ^SP, where 
$ G C MxAr , * G C NxN . For simplicity, we assume that * 
is an orthonormal basis although more general dictionaries are 
indeed possible [4]. 

The essence of compressed sensing, as Donoho, Candes, 
Romberg, and Tao show in [1], [2], is that the under- 
determined equation system (1) can be solved provided that: 

1) The vector x is sparse; i.e., only few (K) elements in 
x are non-zero. 



K=\{x i \x i ^0,i = l,...,N}\ 



(2) 



x can also be approximated sparsely if it is compressible 
[3, Sec. 3.3], meaning that its coefficients sorted by 
magnitude decay rapidly to zero. 
2) The system matrix A obeys the Restricted Isometry 
Property (RIP) with isometry constant 8k > 0, defined 
as follows: 



< || Ax 



\l<(l + 6 K )\\x\\l 



(3) 
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for any at most X-sparse vector x such that [5]: 

8k + <W + S 3K < 1. (4) 

This holds with high probability when 3? is gener- 
ated with zero-mean independent identically distributed 
(i.i.d.) Gaussian entries with variance A. Note that (3) 
and (4) are sufficient but not necessary conditions, and 
rather conservative conditions indeed, as shown in [6]. 
3) The measurement process captures a sufficient amount 
of measurements M [7]: 



M > CK log 



(5) 



where C is a fairly small constant which can be calcu- 
lated as a function of 4£ [5]. (5) holds for the Gaussian 
measurement matrices €> mentioned above. 

Given the measurements y, the unknown sparse vector 
x can be reconstructed by solving the following convex 
optimization problem [8, Sec. 1.3]: 



argmm 

||y-Au|| 2 <e 



(6) 



where the fidelity constraint ||y — Au||2 < e ensures consis- 
tency with the observed measurements to within some margin 
of error, e, which is chosen sufficiently large to accommodate 
the error n. The form of the optimization problem in (6) 
is known as Least Absolute Shrinkage and Selection Op- 
erator (LASSO) [9] or Basis Pursuit De-Noising (BPDN) 
[10] and also comes in other variants such as the Dantzig 
selector [11]. In addition to the convex optimization approach 
to reconstruction in compressed sensing, there exist several 
iterative/greedy algorithms such as Iterative Hard Thresholding 
(IHT) [12], or Subspace Pursuit (SP) [13] and Compressive 
Sampling Matching Pursuit (CoSaMP) [14] as well as the 
more generalized incarnation of the two latter, Two-Stage 
Thresholding (TST) [15]. We generally refer to such convex 
or greedy approaches as reconstruction algorithms. The recon- 
struction algorithms generally assume the noise to be white 
and independent of the noiseless measurements y = Ax. In 
particular, to the best of the authors' knowledge, the case of 
measurement noise correlated with the measurements has not 
been treated in the existing literature. Such correlation arises 
in for example the case of low-resolution quantization. As we 
demonstrate in Section II, this case poses a problem for the 
accuracy of the found solution x. 

In this paper, we propose a simple yet efficient approach 
to alleviating the problem of correlation between the noiseless 
measurements y and the noise n. Our proposal boils down 
to a simple scaling of the solution x. Through numerical 
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experiments we demonstrate how correlated measurements and 
noise adversely affect the reconstruction error and demonstrate 
how our proposal improves the estimates considerably. 

As an application example, we demonstrate the proposed 
approach in the case of low-rate scalar quantization of the 
measurements y which can be observed to introduce the 
mentioned correlated measurement noise. We demonstrate how 
a well-known linear model used for modeling such correlation 
in scalar quantization is equivalent to the model of correlated 
measurement noise considered in this work. 

The article is structured as follows: Section II introduces 
the considered model of correlation between compressed mea- 
surements and noise and proposes a proposes a solution to 
enhance reconstruction under these conditions, Section III 
describes simulations conducted to evaluate the performance 
of the proposed approach compared to a traditional approach, 
Section IV presents the results of these numerical simulations, 
Section V provides discussions of some of the presented 
results, and Section VI concludes the article. 

II. Methodology 

A. Correlated Measurements and Noise 

We consider additive measurement noise n which is corre- 
lated with the measurements y. We model the correlation by 
the linear model: 



y = aAx + w, 



(7) 



where w is assumed an additive white noise uncorrelated with 
x and < a < 1 where a = 1 covers the ordinary case of 
uncorrelated measurement noise. A is the product of a mea- 
surement matrix <fr with i.i.d. Gaussian entries ~ TV (0, -p-) 
and an orthonormal dictionary matrix \I>. The model (7) results 
in the following additive noise term: 



n = y y 

= aAx + w — Ax 
= (a — l)Ax + w 



(8) 
(9) 
(10) 



We define y = Ax to signify the measurements before 
introduction of additive noise. It is readily seen from (10) that 
n is correlated with x. The noise variance is 



1 



1 

M 



((a-l) 2 E[y T y] +E[w T w]), 

(ID 

which can be calculated by assuming that cr? = jj E [y T y] 
and cr^, = -jjj E [w T w] are known or can be estimated. For 
example, we show in Section II-F how <r? can be estimated. 
Likewise, we show an example for cr 2 in the case of quanti- 
zation in Section II-E, (23). 

The specific problem caused by correlated measurements 
and noise as modeled by (7) is that the noise itself is partly 
sparse in the same dictionary as the signal of interest, x. 
Intuitively, this causes a solution x as given by, e.g., (6) to 
adapt to part of the noise as well as the signal of interest, 
unless steps are taken to mitigate this effect. 



B. Proposed Approach 

Using the model in (7), we propose the following re- 
construction of the sparse vector x instead of the standard 
approach in (6). Equation (7) motivates replacing the system 
matrix A by its scaled version aA. We exemplify this ap- 
proach by applying it in the BPDN reconstruction formulation 
as below. Replacing A by aA in the standard approach (6), 
we arrive at 

xi = argmin ||u||i. (12) 

u: ||y-aAu|| 2 <e 

Since e should be chosen to accommodate the level of noise 
in the measurements y, we can see that, one choice could be 
to set 



in (6), or 



e — w 2 



(13) 



(14) 



in (12). Since the noise terms n and w are assumed unknown, 
(13) and (14) are not realistic choices of e. The optimal choice 
of e is dependent on the true solution x, and is therefore 
difficult to obtain in practice as exemplified for more general 
inverse problems in, e.g., [16]. For this reason, various rules 
of thumb exist for the selection of e. One such choice is found 
in [17, Sec. 5.3]: 



M + 2\ 



(15) 



where a is the noise level (standard deviation) of the stochastic 
error n or w in (1) or (7), respectively. 

C. Additional Insight on the Proposed Approach 

As outlined in Section II-B, the model of the correlation 
between n and y suggests scaling A in the constraint of (12). 
In fact, as we show here, the same solution can be obtained 
simply by scaling the solution found by the optimization 
formulation (6). 

Proposition 1. The following optimization formulation is 
equivalent to the formulation (12), i.e. their solutions are 
identical: ^ 

x 2 = — argmin ||v||i. (16) 

« v: ||y-Av|| 2 <e 

To see why (16) is equivalent to (12), consider the opti- 
mization problem over the variable v 



x 2 



argmin 

v: ||y-Av|| 2 <e 



1 

— V 

a 



argmm ||u||i, v = au 

||y-aAu|| 2 <£ 



(17) 



Xl 



The equalities in (17) hold since the solutions to the opti- 
mization problems are unique under the conditions of sparsity 
of x and RIP of A [7]. Thus, down-scaling the solution to 
the optimization in (16) by a results in the same solution x 2 
as the solution xi to (12). Please note that all constraints in 
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(12), (16) and (17) use the same value of e given by (15) with 
a = <r w , the standard deviation of the entries in w in (7). 

In short, Proposition 1 says that for compressed measure- 
ments with noise correlated with the measurements according 
to the model (7), given the correlation parameter a, when 
the signal x is reconstructed using BPDN, (6), the obtained 
solution should be scaled by the factor — to account for the 
effect of the correlation. 

Proposition 1 has been verified through simulations com- 
paring the solutions (12) and (16). Numerical results of this 
verification are presented in Section IV-B. 

D. Optimality of the Proposed Approach 

In relation to the method proposed in Sections II-B and II-C, 
it is of course interesting to investigate whether the corrective 
scaling by a in the reconstruction of x is indeed optimal. To 
investigate this, consider the following optimization formula- 
tion: 

X/3 = 4 argmin ||u||i, (18) 



||y-A*u|| 2 < e 



where e is given by (15) and the optimization problem is 
evaluated for a number of values of j3 € [a — j3\ , a + fa] 
for a given value of a used in the correlated noise model 
(7) and a suitable choice of (3\ and /3 2 - The numerical results 
of this investigation can be found in Section IV-C. j3 = a 
intuitively seems a suitable choice, but numerical experiments 
indicate that it is in fact not optimal. An explanation of this 
observation is offered in Section V. 

E. An Application: Quantization 

As a practical example where the introduced measurement 
noise is correlated with the measurements, we investigate low- 
rate scalar quantization of the individual compressed measure- 
ments in y. Quantization is usually modeled by an additive 
noise model [18]: 



y = Q(y) = y + q, 



(19) 



where y is the original value before quantization, which we 
consider as y <G R. Q(-) is the (non-linear) operation of scalar 
quantization, mapping y to an index i representing a quantized 
value y 



Q ■ y->yu a y e Ri,ie {!,■■■, L}, 



(20) 



where the range of input values is partitioned into L regions 
Ri, i € {1,...,L} and any value y <G Ri is quantized to 
the point yi e Ri. For input y with unbounded support, the 
regions R t can be defined as follows: 



Ri, 



ip%-i,Pi], 
(Pi-i,Pi), 



for i = 1, 
for i = L, 



(21) 



where p n = — oo Api = oo. The additive noise q — y — y 
represents the error introduced by quantizing y to the value y. 

Various modeling assumptions are typically made about q. 
One type of quantizers has centroid codebooks, i.e. quantiz- 
ers where the reconstruction points y^ are calculated as the 



respective centroids of the distribution of the input y in each 
of the regions Ri, e.g., Lloyd-Max quantizers [19], [20]. For 
quantizers with centroid codebooks, q is correlated with the 
input x. A model of this correlation used in the literature is 
the so-called gain-plus-additive-noise model [21, Sec. II]: 



y = Q(y) = ay + r, 



(22) 



where a <G [0, 1] and r is an additive noise, assumed uncorre- 
cted with y. The variance of r is 



°l = ot(l - a)o%. 



The variance of q is 



°q = C 1 - a ) a h 



(23) 



(24) 



which is easily seen by inserting (23) in a 2 q = (a — l) 2 o-y+a 2 . 

The parameter a can be computed for a specific quantizer. 
One way to do this is to estimate it empirically by Monte- 
Carlo simulation. From [21, Eq. (8)] we have 



2 ' 



(25) 



The procedure is to generate a random test sequence y, 
quantize it with the given quantizer Q designed 1 for the p.d.f. 
of y, estimate the variances a 2 and cr? from the realizations 
of y and q = y — y, and use these to calculate (25). 

The model (22) of the quantizer corresponds to the proposed 
model of correlated measurements and noise described by (7), 
where r = w. Please note that the model, (22), considers scalar 
quantization. In the case of quantization of a vector v, we use 
Q(v) to signify scalar quantization of the individual elements 
of the vector v. 

We consider quantization of compressed measurements y 
of the signal x: 



y = Q (Ax) 

= Ax + q 
w aAx + w, 



(26) 
(27) 
(28) 



where 



• qq' 



e [yy T ] = oft 



and I is the M x M identity matrix. 

Approximating the quantization operation by the noise 
model in (28), we propose using the reconstruction technique 
(16) to improve reconstruction with scalar quantized com- 
pressed measurements, (26), as an example of noise correlated 
with the measurements. 

F. Estimates of Noise Variance 

Provided that x is known to be sparse with K non-zero 
elements, and A obeys the RIP with some constant 6k, o\ can 
be approximated, requiring only knowledge of K and the p.d.f. 
of the non-zero entries in x. If we assume that the individual 

'The quantizer can for example be trained on test data representing y or 
calculated based on the known or assumed probability density function (p.d.f.) 
of y. 
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non-zero entries in x are distributed i.i.d. Gaussian ~ A/"(0, 1), 
we have 

E [y T y] = E [x T A T Ax] = E [||Ax|||] 

~E[||x||2], (29) 

where the approximation in (29) follows from (3). Since the 
non-zero entries of x are i.i.d. Gaussian distributed, 1 1 x 1 1 § is 
X 2 -distributed with K degrees of freedom [22, Sec. 8.7.2]. 
This leads to: 

E [y T y] « K. (30) 

Estimates of the corresponding noise variances follow from 
(23) and (24). 

When K is unknown, noise variance estimates given by 
(23) and (24) can be obtained from a known <r|. In hardware 
implementations, <r? can be considered known through the use 
of automatic gain control prior to quantization or by other 
means of estimating signal variance prior to quantization. 

III. Simulation Framework 

In this section we present the numerical simulation set-up 
used to evaluate the reconstruction method proposed in (16). 

Donoho & Tanner have shown in [6] that compressed 
sensing problems can be divided into two "phases" according 
to their probability of correct recovery by the method (6). 
When evaluating the probability of correct reconstruction 
of a sparse vector x over the parameter space defined by 
8 = jq- £ [0, 1] and p = e [0, 1], a given problem can be 
proven to fall into one of two phases where the probability of 
correct reconstruction is close to 1 (feasible) and (infeasible), 
respectively. These two phases are divided by a sharp phase 
transition around the correct reconstruction probability of 50% 
as drawn in Fig. 1 ( — ). The feasible phase lies below the 
transition and the infeasible phase lies above. Compressed 
sensing is utilized most efficiently when operating close to 
the phase transition in the feasible phase since x can be 
reconstructed with the highest possible number of non-zero 
elements K, given N and M, here. This phase transition 
occurs in the case of noiseless measurements, in the limit 
of AT — > oo. The theory still holds for finite N, but the 
phase transition is shifted downwards with respect to p in 

the (8, p) -parameter space, see Fig. 1 ( ). It has also been 

shown that a similar transition occurs at the same location in 
the noisy case, i.e. (1) [23]. In the noisy case, the squared 
norm of the reconstruction error, ||x — relative to the 
measurement noise variance er^ is bounded in the feasible 
region and unbounded in the infeasible region. 

In all simulations, we apply the proposed approach 
to test signals generated randomly according to 
the following specifications: size of x vector 
N = 1000; number of compressed measurements 
M e {200,300,400,500,600,700,800,900,1000}. The 
non-zero elements of x are i.i.d. <~ A/"(0, 1); the number 
of non-zero elements K is selected for each value of M. 
This is done by calculating the largest possible K for 
each M according to the lower bound on the 99% phase 
transition for finite N = 1000 by the formula given in [6, 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 



S [-] 

Fig. 1. The theoretical Donoho-Tanner phase transition for N — > oo, lower 
bound for N = 1000, and points corresponding to the values of K chosen 
for test signals. 

Sec. IV, Theorem 2], drawn in Fig. 1 ( ). The resulting 

values are K e {1,17,41,73,115,167,235,330,542}. The 
corresponding (8, p)-points are plotted in Fig. 1 (x). 

The measurement matrix 4? has i.i.d. entries <~ Af(0, -p) 
and we use the dictionary \& = I, so that A = We repeat 
the experiment T = 1000 times for randomly generated x 
and 3? in each repetition and average the reconstructed signal 
Normalized Mean Squared Error (NMSE), V, over all solution 
instances Xj, i6 [1,7]: 

^ = E%#- (31) 

j=1 H X *ll2 

To enable assessment of the quality of the obtained results, 
we plot the simulated figures with error bars signifying their 
95% confidence intervals computed under the assumption of a 
Gaussian distributed mean of the NMSE, see e.g. [24, Sec. 
7.3.1]. The simulations were conducted for reconstruction 
using regular BPDN (6) vs. our proposed approach (16). 
The numerical optimization problems were solved using the 
SPGL1 2 software package [25]. 

Regarding the choice of e, for regular BPDN (6), we chose e 

according to (15), with a = ^J~a^ from (24). For our proposed 

approach (16), we chose e according to (15), with a = y / af 
from (23). For both compared approaches, we consider a? 
known. As demonstrated in Section IV-C, e could be chosen 
better from empirical observations to provide smaller error in 
the reconstruction, i.e. ||x — x||. We chose the values (15) as 
practically useful values for fairness of the evaluation of our 
proposed method. 

All scripts required to reproduce the simulation results are 
openly accessible 3 . 

IV. Numerical Simulation Results 

In this section we present results of the numerical simula- 
tions conducted according to Section III. Firstly, we evaluate 

2 SPGL1: A solver for large-scale sparse reconstruction (http://www.cs.ubc. 
ca/labs/scl/spgll). 

3 http://github.com/ThomasA/cs-correlated- noise 
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TABLE I 

Correlation parameter values used in Figs. 2-4. 
Equiv. quantizer resolution a (Lloyd-Max) a (uniform) 



1 bit/sample 
3 bit/sample 
5 bit/sample 



0.6366 
0.9655 
0.9975 



0.6366 
0.9626 
0.9965 



the proposed method under artificial correlated measurement 
noise generated according to (7). Secondly, we evaluate the 
method under correlated measurement noise incurred by scalar 
quantization of the compressed measurements. These results 
are shown in Section IV-A. Furthermore, we present results of 
simulations conducted to assess the validity of Proposition 1 
in Section IV-B as well as results in Section IV-C to shed light 
on how the choices of the parameters /3 and e in (18) affect 
the main results. 

A. Main Results 

In this section, noise variance and correlation parameters 
are first set equal to the corresponding parameters estimated 
for the Lloyd-Max quantizer used later in this section, for 
comparability. The parameter values for a are listed in Table I. 
The listed values of a (Lloyd-Max) are used together with 
dp calculated from (23) to generate correlated measurement 
noise according to (7). In the conducted simulations, BPDN is 
used to reconstruct x 2 from the compressed measurements y. 
We compare the standard (correlation-unaware) reconstruction, 
(6), of the signal (denoted "BPDN" in Fig. 2) to the recon- 
struction obtained by our proposed method, (16), of scaling 
the reconstructed signal to account for correlation (denoted 
"BPDN-scale" in Fig. 2). Selected results for equivalent quan- 
tizer resolutions 1 bit/sample, 3 bit/sample, and 5 bit/sample 
are shown in Fig. 2. The proposed method is observed to 
improve the reconstruction error V by 7.3 dB to 1.3 dB (for 
increasing p) at 1 bit/sample, 3.1 dB to 0.26 dB (for increasing 
p) at 3 bit/sample, and 0.86 dB to 0.059 dB (for increasing p) 
at 5 bit/sample. 

The experiments for quantized measurements are conducted 
exactly as above, with the exception that the measurements y 
are quantized using a Lloyd-Max quantizer [19], [20]. The 
correlated noise model uses the values of a (Lloyd-Max) for 
the selected quantizer resolutions listed in Table I. 

Selected results for quantizer resolutions 1 bit/sample, 
3 bit/sample, and 5 bit/sample with Lloyd-Max quantization 
are shown in Fig. 3. It can be observed that the reconstruction 
error figures V agree well with those simulated with artificially 
generated correlated noise in Fig. 2. The observed improve- 
ments by the proposed method are almost identical to those 
observed for artificial noise: 7.6 dB to 1.3 dB at 1 bit/sample, 
3.1 dB to 0.26dB at 3bit/sample, and 0.80dB to 0.028dB at 
5 bit/sample. 

To evaluate our proposed approach for a more practi- 
cal quantization scheme than the non-uniform Lloyd-Max 
quantizer, we additionally simulated results where the mea- 
surements y are quantized using a uniform quantizer with 
mid-point quantization points, optimized for minimum mean 
squared error (MMSE) of the quantized measurements. This 
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(a) Noise of var. equivalent to 1 bit/sample quantizer. 
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(c) Noise of var. equivalent to 5 bit/sample quantizer. 

Fig. 2. Simulated NMSE of reconstruction using BPDN vs. relative number 
of measurements for parameters a and cr^ set equal to the corresponding 
values for Lloyd-Max quantizers at the respective rates specified under figures 
(a)-(c). 



serves to evaluate how well the proposed approach performs 
for a more practical quantizer type that does not theoretically 
obey the quantization noise model (22) due to the fact that 
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(c) 5 bit/sample quantizer. 

Fig. 3. Simulated NMSE of reconstruction using BPDN vs. relative number 
of measurements for parameters a and al set equal to the corresponding 
values for Lloyd-Max quantizers at the respective rates specified under figures 
(a)-(c). 



its reconstruction points are not the centroids of the input 
signal's p.d.f. in the quatizer's input regions. The correlated 
noise model uses the values of a (uniform) from Table I. 



Selected results for quantizer resolutions 1 bit/sample, 
3 bit/sample, and 5 bit/sample with uniform quantization are 
shown in Fig. 4. The observed improvements by the proposed 
method are close to those observed for artificial noise: 7.6 dB 
to 1.3dB at lbit/sample, 3.2dB to 0.28dB at 3bit/sample, 
and 0.89 dB to 0.073 dB at 5 bit/sample. The results in Fig. 3a 
and 4a are identical due to the fact that the 2-level Lloyd- 
Max quantizer is a uniform 2-level quantizer optimized for 
MMSE of the quantized values. It can also be observed that 
the uniform quantizer for 3 bit/sample and 5 bit/sample results 
in slightly larger reconstruction error while the improvement 
by our proposed method is preserved. 

B. Empirical Assessment of Validity of Proposition 1 

To empirically assess the validity of Proposition 1, the 
experiments in Section IV-A for synthetic correlated noise 
have been repeated using the reconstruction method (12). The 
resulting estimates xi were then compared to the correspond- 
ing estimates x 2 . In other words, this experiment evaluates the 
difference in the solutions found by scaling the measurement 
matrix <I> by a prior to reconstruction as opposed to scaling 
solutions x by l/a after reconstruction. 

For each signal realization and instance of K and M, the 
norm of the error between the two estimates is evaluated: 



Xi - X 2 2 



(32) 



For the experiments with random noise in Section IV-A, we 
observed a total of 87 instances where e > 10~ 6 . This is a 
fraction of 87/27000 = 0.32% of the total number of signal 
realizations. For the experiments with Lloyd-Max quantiza- 
tion, we observed a total of 77 instances where e > 10~ 6 . 
This is a fraction of 77/27000 = 0.29% of the total number 
of signal realizations. The observed distributions of errors 
e > 10~ 6 corresponding to the experiments behind Figs. 2 
and 3 are shown in Figs. 5 and 6. 

C. Empirical Investigation of Scaling Factors and Regulariza- 
tion Parameters 

In order to assess the optimality of the proposed approach as 
described in Section II-D, we conducted simulations for values 
of ft in (18) using artificial pseudo-random noise generated 
according to the model (22). Since the reconstruction error 
performance is also affected by the choice of e in (18), we 
similarly performed the simulations over different values e. 
Preliminary simulations indicated that V (see (31)) evolves in a 
quasi-convex manner over (3 and e. Based on this observation, 
we have used the Nelder-Mead simplex algorithm [26] to 
find the (/3, e)-optimal error figures V for each of the points 
(M, K) listed in Section III. The results for all (M, K) 
with correlated noise generated according to each of the 
values a (Lloyd-Max) in Table I are shown in Table II. The 
optimal regularization parameter values for ordinary BPDN 
are denoted e\, while the optimal scaling and regularization 
parameter values for the proposed method are denoted /3 2 and 
£2- 

It was expected that a would be the optimal choice of (3, i.e. 
/3 = a. However, it turns out that the (empirically observed) 
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Fig. 4. Simulated NMSE of reconstruction using BPDN vs. relative number 
of measurements for parameters a and <rj set equal to the corresponding 
values for uniform quantizers at the respective rates specified under figures 
(a)-(c). 



optimal value of /3 2 is typically slightly smaller than a with 
observed values (3 2 € [0.74a, 0.98a], depending on (M, K). 
An exception is seen in Table Ilia, where (3 2 € [1.0a, 1.2a]. 
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Fig. 5. Histograms of observed discrepancies, e > 1 ■ 10~ 6 between the 
proposed methods in (12) and (16) in the experiments with synthetic noise in 
Section IV-A. 



The optimal values of the regularization parameter e are 
similarly found to be lower than the values given by (15). For 
the baseline method (6), the (empirically observed) optimal 
values are observed as ei e [0.32e, 0.84e], depending on 
(M, K), where e denotes the values given by (15) as described 
in Section III. For our proposed method (16), the optimal 
values are generally closer to the values given by (15) with 
observed values ei e [0.45e, l.Oe], depending on (M,K). 

It is important to note that the demonstrated advantage of 
our proposed approach in Section IV-A is not merely a result 
of a particularly lucky choice of e, as these experiments testify. 
The observed NMSE of our proposed method, V2, consistently 
outperforms the baseline approach, V\. The improvement is 
consistent across different correlation parameters a as seen 
in Table II where Vi is smaller than V\ by 13 dB, lldB and 
7.1 dB in Tables Illa-IIIc, respectively, for (M, K) = (200, 1). 
At the other extreme of (M, K) = (1000, 542), V 2 is smaller 
than Vi by 0.14dB, 0.18dB and 0.19dB, respectively. 

V. Discussion 

It was shown in Section IV-B that there were a few 
discrepancies found in the conducted simulations for which 
Proposition 1 did not hold within an error e < 10~ 6 . These 
occurrences were found to be very rare and we attribute these 
to effects of numerical precision in the reconstruction. 

As seen from the experimental results in Section IV-C, the 
correlation parameter a from (7) may in fact not be the optimal 
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Fig. 6. Histograms of observed discrepancies, e > 1 • 10~ 6 between the 
proposed methods in (12) and (16) in the experiments with quantization noise 
in Section IV-A. 



choice of scaling parameter, as expressed by (3 in (18). The 
generally smaller values found in Section IV-C to be optimal 
for BPDN reconstruction according to (18) can be explained 
by the fact that they scale the estimate xp larger. It is well- 
known in the literature that the t'l-norm minimization approach 
represented by, e.g., (6) tends to penalize larger coefficients 
of x more than smaller coefficients [27], thus estimating the 
former relatively too small. Therefore, it is possible to choose 
a scaling parameter /3 < a in (18) that improves the estimate 
i.e. yields smaller \\kp — x|| compared to \\x a — x||. At 
this time, we cannot quantify the optimal /3 analytically and 
it depends on the indeterminacy and/or measurement density 
of the performed compressed sensing. 

VI. Conclusion 

We proposed a simple technique to model correlation be- 
tween measurements and an additive noise in compressed 
sensing signal reconstruction. The technique is based on a 
linear model of the correlation between the measurements 
and noise. It consists of scaling signals reconstructed by a 
well-known r?i-norm convex optimization method according 
to the model and comes at negligible computational cost. 
We provided practical expressions for computing the scaling 
parameter and the reconstruction regularization parameter. 

We performed numerical simulations to demonstrate the 
obtainable reconstruction error improvement by the proposed 
method compared to ordinary «?i-norm convex optimization 
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reconstruction for noise generated according to the model. We 
further demonstrated as an example that the model applies 
well to low-rate scalar quantization of the measurements; 
both Lloyd-Max quantization that complies accurately with the 
correlation model, as well as a more practical uniform quan- 
tization. For example, simulations indicated that the proposed 
method offers improvements on the order of 1 dB to 7 dB for 
1 bit/sample quantization, depending on the indeterminacy of 
the performed compressed sensing. 

We conducted numerical simulations to evaluate the validity 
of our results which confirm that the improvements offered by 
the proposed method are not merely a coincidental result of 
the suggested practical choices of scaling and optimization 
regularization parameters. These results further indicated that 
the proposed method is robust to the choice of scaling and 
optimization regularization parameter in the sense that a sub- 
optimal choice still leads to considerable improvements over 
the ordinary convex optimization reconstruction method. 
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